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Abstract 

There are three classical divergence measures exist in the literature on information theory 
and statistics. These are namely, Jeffryes-Kullhack-Leiber J^, J-divergence. Sibson- 
Burbea-Rao J^, J^jj Jensen-Shannon divegernce and Taneja Jllf Arithmetic- Geometric di- 
vergence. These three measures bear an interesting relationship among each other. The 
divergence measures like Hellinger ^Sl discrimination, symmetric divergence, and tri- 

angular discrimination are also known in the literature. In this paper, we have considered 
generalized symmetric divergence measures having the measures given above as particular 
cases. Bounds on the probability of error are obtained in terms of generalized symmetric 
divergence measures. Study of bounds on probability of error is extended for the difference of 
divergence measures. 

Key words: J-divergence; J ens en- Shannon divergence; Arithmetic- Geometric divergence; 
Probability of Error, f— divergence 

AMS Classification: 94A17; 62B10. 

1 Introduction 

Let 



P = {Pl,P2,--,Pn 



Pi > 0,^pi = 1 I , n > 2, 



1=1 



be the set of all complete finite discrete probability distributions. For all P,Q £Tn, the following 
measures are well known in the literature on information theory and statistics: 

Let us consider the measure 



CsiPWQ) 



Js{P\\Q) = [s{s-l)]-' 



l-s 



.1=1 



+ pl-'q!) 



J{P\\Q) = j:ip^-q^)i^{'^), 



i=l 



s = 0,1 



for all P, Q G r„ 

The measure ([ID can be seen in Burbea and Rao [3] and Taneja |1H I13| . These authors 
studied the above measure using the multiplicative constant as (s — while Taneja |14j 

studied considering it as [s{s — , s 7^ 0, 1. 

The expression ([1]) admits the following particular cases: 
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{i)C-iiP\\Q)=C2{P\\Q) = l^{P\\Q), 

(ii) CoiP\\Q) = Ci{P\\Q) = JiP\\Q), 

(iii) Ci/2{P\\Q) = 8h{P\\Q), 
where 



^>iP\\Q) = x'iP\\Q) + x\Q\\P) = Yl 



{Pi -QifiPi+Qi) 



1=1 



Piqi 



and 



1 " 

h{P\\Q) = ::Y.(^ 



(2) 



(3) 



i=l 



are the symmetric divergence I15j and Hellingar's discrimination [S] respectively. More 
details on these divergence measures can be seen in Taneja 
Let us consider now the another generalized measure 



^(^'IIQ) 



ITs{P\\Q) 

m\Q) = 



Sis 



r 



1-1 



i=i ^ 



y 2 



l-s 



12 Pi In 

i=l 



2pi 



T(p||g) = E 



1=1 



' \2Jpiqi 



+ E 9i In 

«=1 



2g» 
Pi+gi 



s = 1 
s = 



(4) 



for all P, Q E r„ 

The measure (jH) is new in the literature and is studied for the first time by Taneja yjj and 
is called arithmetic and geometric mean divergence measure. More details on these divergence 
measures can be seen in Taneja [TU IT^ . 

The measure @ admits the following particular cases: 

(i) e-i(P||Q) = iA(P||Q). 

(ii) UP\\Q) = m\Q)- 

(iii) ii/2{P\\Q)=^d{P\\Q). 
{\n)UP\\Q) = T{P\\Q). 

(iv) e2(P||Q) = i^^(P||Q). 
where 



A(P||Q)=5; 



{Pi 



i=l 



Pi + Qi 



and 



d{P\\Q) = l-Y^ 



i=l 




(5) 



(6) 



are the triangular discrimination and d-divergence respectively. 

The symmetric divergence measures ([T|) and ^ admit several particular cases. An inequality 
among these measures [Hj is given by 



\a{p\\q) < i{p\\Q) < h{p\\Q) < MP\\Q) < IapWQ) < np\\Q) < ^^iP\\Q). (7) 

In this paper our aim is to obtain the bounds on the probability of error in terms of the 
measure ([1]) and ^ and then establish examples of the seven measures given in d?]). Some 
studies on divergence measures and probability of error can be seen in Taneja \10\ lllj. 
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2 Error Probability for Two Class Case 



Suppose we have two pattern classes C = {Ci, C2} with "a priori" probabiHty pi = Pr{C = Cj}, 
i = 1,2. Let the feature x on X have a class-conditional probability density function P{x\Ci) 
are known. Given a feature x on X, we can calculate the conditional (a posteriori) probability 
P{Ci\x) for each z, by the Bayes rule: 



P{Ci\x) = Pr{C = Ci\X = x} 



PiP{x\Ci) 
E PkP{x\Ck) 

k=l 



-,i = l,2. 



It is well known that the decision rule which minimizes the probability of error is the Bayes 
decision rule which chooses the hypotheses (pattern classes) with the largest posterior probabil- 
ity. Using this rule, the partial probability of error for given X = x is expressed by 

P{e\x) = l-max{P(Ci|x),P(C2|x)} = min{P(Ci|x),P(C2|a;)}. 

Prior to observing X, the probability of error Pej associated with X is defined as the expected 
probability of error, i.e., 

Pe = Ex {P{e\x)} = J P{e\x)p{x)dx, 

X 

2 

where p{x) = E piP{x\Ci) is the unconditional density of Xcvaluatcd as x. 

i=l 

In terms of the prior probabilities for the two class case, let us consider generalized divergence 
measures: 

fjs, s^O,l 
1 J, s = 0, 1 ' 



Cs 



(8) 



where 



and 



Js = [s{s - 1)]-^ J {pix\Ciyp{x\C2)^-'+p{x\C2yp{x\Ci)^-') dx - 2 
J = J (P(x|Ci)-P(x|C2))log^^^'''^^^ 



P(a;|C2) 



Let us consider now 



'iTs, 




< I, 


s = l 


T, 


3 = 



(9) 



where 

ITs = [s{s - 1)]-' 

'Pix\c\: 



p{x\Ciy +p{x\C2y\ [ p{x\Ci) +p{x\Ci) 



l-s 



dx — 1 



I 



In 



2P(x|Ci) 



P(x|Ci) + P(a;|C2) 



+ ^i^ln 



2P(x|C2) 



P(x|Ci) + P(a;|C2) 



dx, 
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and 



P{x\Ci) + P{X\C2) \ / P{x\Ci) + P(X|C2) \ 



2 J "' \2^P{x\Ci)P{x\C2) 

Let us define the above measures in more general way 



Cs{Pl,P2) = 



J,{Pl,P2) S = 0, l' 



where 



JM,P2) = [sis -!)]-'{ / \{pip{x\Ci)r {P2P{X\C2)) 



+ {P2P{x\C2)r {pip{x\Ci))^-'] dx-l],s^O, 



and 



J = J {piP{x\Ci)-p2Pix\C2))ln 
Similarly let us define 



PiPjxlC-i) 

P2P{X\C2) 



dx. 



^s{Pl,P2) = < 



7r,(pi,p2), s^o,i 

I{Pl,P2), S = l , 

[T{pi,p2), s = 



where 



ITs{pi,P2) = [s{s-l)]-'y 



'Mx\ci)r + iP2Pix\c2)y 



Pipix\Ci) + P2Pix\Ci) 



1-s 



dx 



I{Pl,P2) 



piP{x\Ci)\n 



2piP(x|Ci) 
piP{x\Ci)+piP{x\C2), 

2p2P{x\C2) 



+ P2P{x\C2)\^ 



PiP{x\Ci)+piP{x\C2)J\ 



dx 



and 



T{pi,P2) = J 
It is easy to verify 



PlP{x\Ci) +P2P{X\C2)\ ( PlP{x\Ci)+P2P{x\C2) \ 

''\2^pW2P{x\Ci)P{x\C2)) 



G ( 2' 2 



and 



2' 2) ~ (2 
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where (s and are as given by ([5]) and Q respectively. 

Using Bayes rules, piP{x\Ci) = p{x)P{Ci\x) and P2P{x\C2) = p{x)P{C2\x), we can write 



and 



where 



Cs(pi,P2) = J pix)Cs{x)dx 

is{pi,P2) = J p{x)£,s{x)dx, 
Js{x) = [s{s - [P{Ci\xrP{C2\x)^- 

Cs{x) = I +P{C2\xrP{C2\xy-' - 1] , 

J(x) = - P{C2\x)) In 



s = 0,1 



(10) 



and 



is{x) = < 



ITJx) = \s(s - I) 



2P(Ci\x) 



+ m|x)ln(,.(,|^ 



i\x)+P(C2\x) 



rp( ) ^ ( PiCi\x) + P(C2\x) \ ( PiCi\x)+PiC2\x) \ 
. ' \ 2 ; \2^P(Ci\x)P{C2\x) J 



S = 1 

s = 



2.1 Bounds on Generalized Divergence Measures 

In this paper we shall obtain error bounds in terms of these generalized divergence measures. 
Before that we review some known results. 

There exist in the literature lower bounds on Pg in terms of different divergence measures. 
For review refer to Taneja |IOl 111] , Kailath [7J gave the following bound: 



-Pe > ^ exp 



where the equality holds for J = oo. Later, Toussaint \17\ I18j gave a tighter and general bound 
as 



1 1 



Pe>^- - 4 exp [-2H{pi,p2)- Jipi,P2)], 



where 



H{pi,P2) = -pilogpi -p2logP2- 



For pi = P2 = 5 ) we have 



1 1 



J 



where the equality hold for both J = and J = oo. 

Toussaint \n\ [T8] still obtain a sharper bound on J in terms of Pg as 

J(pi,P2) > (2Pe-l)log 



I -P. 
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Whenpi = P2 = h, one gets 



J>2(2Pe-l)log 



P. 



I -P. 



Theorem 2.1. We have 
where 

UPe) 



Cs{pi,P2) > CsiPe), 



r Js{Pe) = [S{S - [Piil - Pef-' + (1 - PeYP}-' " l] S ^ 0, 1 

\j(Pe) = (2Pe-l)ln(i^), S = 0,1 



Proof. It is sufficient to show the result only for s 7^ 0, 1, since for s = 0, 1 the result is already 
known in the literature or follows in view of continuity with respect parameter s. 

We have 

Pe{x) = min{P(Ci|x), P{C2\x)] . 

As C,s{x) given by is symmetric with respect to P{Ci\x) and P{C2\x), let us consider 
P{Ci\x) = Pe{x) and P{C2\x) = 1 — Pe{x). Making these substitutions in ([TO]) , we get 



Cs(x) 



Js{x) = [S{S - PeixY (1 - Peix))^-" (1 " Pe(x))^ PeixY'' " 1 

x)_ 



J(x) = (2Pe(x)-l)ln(^ 



s = 0,1 



Now consider a function 

' [s(s - l)]-i \a' (1 - a)^"" + (1 - a))' a^" 
^(2a-l)ln(^^ 

or, simply, 



(11) 



fs{a) 



, s/0,1 
s = 0,1 



We have 



and 



fs{a) = [s{s - \a' (1 - af-' + (1 - a))^ a^-^ - ll , s / 0, 1. 



= [s{s - l)a(l - a)]-' [{s - l)a^ (1 - a)^- 

+ (1 - s)a^-'{l -a) -{I- aYa^-'] 

f'Jia) = a'-\l - a)-'-' + (1 - aY-'a-'-' 



for all < a < i. 

This gives/" (a) > 0, for anys ^ 0, 1. For s = 0, 1 the result follows by continuity, i.e, /s(a) 
is convex function of a (0 < a < ^) for any s G (— oo, oo). 

Taking expectation on both sides of (jlip and using Jensen's inequality we get the required 
result. □ 
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Corollary 2.1. When pi =P2 = h, we have 



Cs> 



,^2(2Pe-l)ln(Y^< 
Theorem 2.2. We have 



2[S{S - [Pi{l - PeY-' + (1 - PeYPl-' - 1] S ^ 0, 1 

s = 0, 1 



where 



UPe) 



ITs{Pe) = [s{s-l)r^ 

m) = \ 



PAn 



2Pe 
2Pe- 



-A + (l-Pe)ln 



_ 1 

27 2 

2(1-Pe) 
2Pe-l 



r(Pe) = (^)ln 



2Pe-l 



2^Pe(l-Pe) 

Proof. Following the lines of Theorem 2.1, we can write 



P,(xr+(i-Pe{x)r\ /ni 



ITsix) = [sis-l)r 

I{x) = 1 [Pe(x) In (^^) + (1 - In (^iFg^ 



r(x) 



2Pe(x)-l 



2^P,{x){l-Pe{x)) 



Now consider a function 



for all < a < i. 
We have 



/T,(a) = {s{s - 1)]-^ 



/(a) 

r(a) 



a In 



2a 
2a- 1 



a°+(l-a)" 
2 



'2a-l 



)ln 



2a- 1 



2^a(l-a) y ' 



s/0,1 

s = 1 

s = 



s/0,1 

s = 1 

s = 



s = 1 

s = 



X _ 2°-2K(a-l)+a(l-a)^] „ / m 1 



2a- 1 
4a(l-a) ' 



and 



/ri'(a) = 2 
/"(a) - 1 



s-2 



a°(l-a)^+a^(l-a)'' 
a2(l-a)2 



T"(a) - °'+(^-"^' 



S = 1 
S = 

, s/0,1 

s = 1 

s = 



(12) 



2a{l-a) ' 
a^+(l-a^ 
" 4a2{l-a)2 ' 

This gives 5" (a) > 0, i.e, Qsip) is convex function of a (0 < a < i) for any s € (—00,00). 

Taking expectation on both sides of (fT2]) and using Jensen's inequality we get the required 
result. □ 
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Corollary 2.2. When pi =P2 = \, we have 



6 > < 



2[s{s-l)X 



P,^ + (l-Pe)^ 

2 



(^) 



P. In 



2Pe 



2P, 

(2Pe - 1) In 



j] + (l-Pe)ln 

2Pe-l 



_ 1 
2 

2(1-Pe) \ 

2Pe-l j ' 



s = 1 
S = 



3 /—Divergence and Probability of Error 

Csiszar have given a measure for the divergence between two probabiUty density functions, 
say p{x) and q{x). This so cahed /—divergence given by 



X 



(13) 



The function /(x), with x £ (0, cxd) is a convex function which has to satisfy the conditions 



/(0)=hm/(n);0/(^ 



0; 0/ 



lira G / 

£4-00 V G 



a hm 



fin) 



(14) 



It can be easily checked that Cf{p, q) > /(I) and that C/(p, q) = /(I) only when p{x) = q{x) 
a.e. Thus, Cj(p, q) — f{l) is a distance or divergence measure in the sense that Cf{p, q) — f{l) > 0. 
However, it is not symmetric in p and q and in general does not satisfy triangle inequality. Some 
applications of /—divergence in connection with divergence measures are given in Taneja and 
Kumar |12j . 

Boekee and Van der Lubbe [2] have introduced the average /—divergence between two hy- 
pothesis Ci and 6*2 in terms of their "a posteriori" probabilities. This average /—divergence is 
defined as 



C/(Ci, C2 



/ ( ^7^1 P{Ci\x)pix)dx = Ex If f ) ^(^il^^ 



P{C2\x) 



P{C2\X) 



(15) 



If we introduce the function f^,{u) = u f {^-[^) and set u = u{x) = P{C2\x), it is easy to see 
from P(Ci|x) = 1 - P{C2\x) that 

c,(c.,c.) = E,{/.(S^)p(c,i.: 

From Vajda [19j it follows that /*(u) is convex on [0,1] and is strictly convex iff f{u) is 
strictly convex. 



3.1 A Class of Upper Bounds 

In [2] it has been shown that the Bayesian probability of error can be upper bounds in terms of 
the average /—divergence C/(Ci,C2). This upper bound is given by 



P. < 



foP{C2) + fooPiCi)-Cf{C,,C2 

/2-/1 



(16) 
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where /2 should be finite with /o = Hm f{u); fi = /(I); /a = /o + /oo; foo = hm 

The above bound is vahd only for every convex function f{u) which satisfies the conditions 
given in ([Ti]) . However, if /*(u) = uf (^^) is symmetric with respect to u = ^ i.e., = 
f^{l — u),\/u £ (0, 1), the bound (fT6|) can be written in a simpler form given by 

^ Of \ f [f^-Cf{Ci,C2)] , (17) 

provided /oo is finite and = — u), Vu G (0, 1). 

As a consequence of result (jl7|) we have the following two theorems in terms of measures 
given in ([1]) and (H]) respectively. 

Theorem 3.1. T/ie following bound holds 

ft < ^ [1 + s(s - lK.(Ci,C2)] , < « < 1, (18) 



C,(c.c,) = £x{/-(^)p(c.|.; 

' [s(s - 1)]"^ [(1 - xy-'x' + - x)" - l] , s / 0, 1 

(2x-l)ln(^) s = 0,l 



w/iere 

/or aZ/x G (0, 1). 
Proof. Let us consider 

C,(c.c.) = £.{/-(f||g)p(c.w 

where 

/c(^)= V A ' (19) 

\x/,(l^) = (2x-l)ln(^), . = 0,1 

with 

= I /^.(^) = - 1)]"' + - + 1)] > s / 0, 1 ^20) 
1 /j(x) = (x — 1) Inx s = 0, 1 

for all X G (0, 1). 

The convexity of the function /^^(x) given ()20p can be seen in Taneja [13]. From the expres- 
sion (fTU]) . we observe that 

/^*^(x) = /^*^(l-x). (21) 

Also, we have 

x-s>oo X I OO otherwise 

and 

/c(l) = 0. (23) 
Expression (fT7|) together with ([2T]) - (j23]) give the required result p^ . □ 
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Theorem 3.2. The following bound holds 

1 



s < 1 



(24) 



where 



with 



for all X £ (0, 1). 
Proof. Let us write 

where 
with 



UCuC.) = E,{fl[g^)piCA.) 



f*j,^{x) = [2sis - 1)]-' [2-- ((1 - x)i-« + xi-^) - 1] , s ^ 0, 1 
f*[x) = i[ln2 + xlnx+(l-x)ln(l-x)], 



/^(x) = iln 



s = 
s = 1 



UCuC.) = E.{fl[g^)piC,\x) 



=i[ln2 + xlnx + (l-x)ln(l-x)], s = 



X fx 



1 



(25) 



/,T.(:c) = [.(.-!)]-! 
/Kx) = flnx+(^)ln(^), 
/y(x) = ^lnx/'^'l 



s = 1 

s = 
s = 1 



(26) 



for all X G (0, 1). 

The convexity of the function /g^(x) given ()26p can be seen in Taneja [13j. From the expres- 
sion (p5]) we observe that 

fU^) = fU^-^)- (27) 
Let us calculate now f^^. We have 



lim 

X— ^oo X 



lim [s{s — 1)] ^ — 

x— ^oo X 

lim \s{s — 1)]^^ 

a;— >oo 

lim \s{s — 1)]~^ 
a;— >oo 

lim [s{s — 1)]^^ 



1\ fx+l 



x * + /x + 1 



2x 



x + 1 



1 1 

2 X 



x^-" + 1 



(x+1)^ 



1 1 

2 ^ X 



X 



+ 



X 



1 1 

2 + x 



ix'' ix + lY 
lim ( 1 + - + lim '- 

X I a-s>oo X 



V ,1 1 

hm I - + - 

1 X 



1 + lim 



(x+1)^ 



a— >oo X 



1. 



(28) 
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We can easily verify that 



lim 



(x + 1)^ 



0, s < 1 

1, s = 1 . 

oo, s > 1 



(29) 



Expressions (|28|) and (p9|) together give 

■[2s(s-l)]~^ [2-^-1], s< 1, s/0 



a;— ^-oo X 



(30) 



oo, 



s > 1 



Also we have 



/^(l) = 0. (31) 
Expression (fT7|) together with (p7|) . (pO|) and (j3T]) give the required result (pH) . □ 



Here below are the particular cases of the Theorems 3.1 and 3.2. These can also be obtained 
directly using result (fT7|) . These examples are the seven measures appearing ([7]). 

Example 3.1. Let us consider the measure 



where 



7(c..c.) = £.{/;(^)m|.)}, 
= (2i - 1) h, (yt^) , Vi e (0. 1). 



We can't obtain the upper bound on the probability of error in terms of J-divergence, since 
according to i2^) . fj^ is infinite. 

Example 3.2. In particular for s = ^ in I118\) . we have the following upper bound on the 
probability of error in terms of the Hellinger distance: 



where 



with 



Pe<-[l-2hiCuC2)], 
h{CuC2) = Ex S^fl {^^) P(C^\x) } , 



f*,i.)='-^^y^f^,y.eio,i). 

Example 3.3. In particular for s = in {2^% we have the following upper hound on the 
probability of error in terms of the Jensen- Shannon divergence: 



- 2 



where 



I{Ci,C2)=Ex{f! 



PjCilx) 

P{C2\x) 



PiCi\x] 
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with 



[ln2 + xlnx+ (1 - x) ln(l - x)] , Vx G (0, 1). 



Example 3.4. Let us consider the measure 



T(c,.c.) = E,{/;(3||)p(c, 



where 



2 \ 2v^x(l -x) 



Vx G (0,1). 



We can't obtain the upper bound on the probability of error in terms of the arithmetic and 
geometric mean divergence, since according to i30\) . fx^ is infinite in this case. 



Example 3.5. In particular for s = ^ in \24\) , we have the following upper bound on the 
probability of error in terms of d-divergence: 



P. < 



1 



1 



2 - \/2/ 



Co 



where 



with 



d{Ci,C2) = Ex{f*d 



( P{Ci\x) 
\P{C2\x) 



PiCi\x] 



f^ix) = i - V2 ( + VT^) , Vx G (0, 1). 

Example 3.6. In particular for s = —1 in ^24\ ), we have the following upper bound on the 
probability of error in terms of triangular discrimination: 

Pe<^[l-A(Ci,C2)], 



where 



with 



A(a,C,) = £.{/l(^)m|.)} 



/i(l■) = (2rc-l)^VIe(0,l), 
Example 3.7. Let us consider the measure 

'P{Ci\x) 



^{Ci,c2) = Ex\f; 



P{C2\X) 



P{Ci\x] 



where 



fUx) 



(2x - 1) 



Vx G (0,1). 



x(l — x) 

We can't obtain the upper bound on the probability of error in terms of symmetric x^— divergence, 
since according to /fl3|). f^^is infinite for s = 2. 



12 



4 Difference of Divergence Measures 

From the Examples 3.1-3.7 we observe that there are only four measures that give upper bounds 
on the probability of error. According to ([1]), these four measures bear the following inequality: 

\a{P\\Q) < I{P\\Q) < h{P\\Q) < 4d(P||Q). (32) 

The inequality ()32p admits the following nonnegative differences 

DdA{P\\Q) = 4(i(P||Q) - ^A(PIIQ), (33) 

Ddh{P\\Q) = id{P\\Q)-h{P\\Q), (34) 
Ddi{P\\Q) = 4d{P\\Q)-IiP\\Q), (35) 
DhiiP\\Q) = h{P\\Q)-IiP\\Q), (36) 

DhA{P\\Q) = h{P\\Q) - \a{P\\Q) (37) 

and 

DjAiP\\Q) = I{P\\Q)-\A{P\\Q). (38) 
The above six measures can be related by the following (ref. Taneja [16]): 

Dia{P\\Q) < ^DhAiPWQ) < ^DdA{P\\Q) < 
6 15 

<lDdh{P\\Q) < ^DddPWQ) < 2Dhi{P\\Q). (39) 



Here below we shall give bounds on the probability of error in terms of the measures ()33p -([38 
Result 4.1. The following bound holds 



e _ 2 



(40) 



where 



with 



DdA{Cl,C2) = Ex |/,*A ^(^il^)} 



fdAix) = ^ - \/2 (V^ + + x{l -x),yxe (0, 1). 

Proof. Let us consider 



where 



/dA(^) = ^ fdA =l-V2{V^ + VT^) + x(i - x) 
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with 



fdAioo) = 2x + 2 - (V^ + 1) V2X + 2 



4(x + l)2' 

Now we shall prove the convexity of the function fdA{x)- We have 



^/2^T2 1 + x-l {x-lf 

JdAix) = 2 - -TTTT + 



and 



2^ \/2^T2 2(x + l)2 4(2: + 1)2 
(x3/2 + l)(x + 1)2 - 4x3/2V2x + 2 



2x3/2(x + l)V2a; + 2 



2a;3/2(x + l)3V2x + 2 V 2 



X + 1 



3/2 + i\ /^ + l\3/2 



X 



3/2 



Vx > 0. (41) 



Now we shall prove the non- negativity of the expression ()4ip . We can easily check that 

+ iV ^ x3/2 _^ 1 



2 J - 2 
On the other side we know that |13j pp. 279: 



(42) 



,3/2 < 



"v/x + 1 \ /x + 1 



3/2 



(43) 



Expressions (|12]) and (|13]) together give 



t;3/2< 



Vi+ 1\ + lA^^^ /x3/2 + l\/x+l 



■ 



< 



3/2 



(44) 



Expression proves the non-negativity of the expression (jH]), i.e., /Ja(^) > 0, Vx > 0. 
This proves the convexity of the function fdA{x)j Vx > 0. 
We have 



fdAi^) = fdAi^-^),xe{o,i) 

7 
4 



(45) 
(46) 



and 



/i = /dA(l) = 0. (47) 
The result (fT7|) together with the expressions ([15]) - ()^7|) gives the required result pUj) . □ 
Result 4.2. The following bound holds 



P. < 



1 



1 



4 - 2V2 - In 2 



Ddi{Ci,C2) 



(48) 
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where 



with 



* fP{Ci\x] 



Ui 



p{C2\x: 



P{Ci\x) 



f2j{x) = 2- 2^/2{^/^+^/T^) - ^ [ln2 + xlnx + (1 -x)ln(l -x)] , Vx G (0,1^ 
Proof. Let us consider 



where 



fdii^) =xfdi 



1 — X 



1 



with 



2 - 2V2 (a/x + Vl - x) - ^ [In 2 + X In X + (1 - x) ln(l - x) 



fdi{x) = 2x + 2- + V2x + 2- ixlnx - ^^In 



X + 1 



Now we shall prove the convexity of the function fdi{x)- We have 

f (x)-2 -^^^ ^ + ^ ^Inx \n( ^ 



and 



x^/^ + 1 - y^^2x + 2 

2x3/2(3; + 1)V2X + 2 



c3/2(x + l)V2x + 2 



^3/2 j_ ^ 



x + 1 



, Vx > 0. 



(49) 



Now we shall prove the non-negativity of the expression ()49p . We know that [14], pp. 358: 



This give 



2 - V 2 y V 2 

By simple calculations, we can check that 



X + l\ ( ^ x3/2 + 1 



(50) 



(51) 



The expressions (f50|) and (f5T]) together give the non- negativity of the expression ([I9|) . i.e., 
f'dii^) > 0, Vx > 0. This proves the convexity of the function fdi{x), Vx > 0. 
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We have 



/l(^) = /l(i-^)'^e(o,i) 



lim 

x—^oo 



M^ = 2-^/2-lln2 = 1 

X 2 4-2\/2-ln2 



and 



/l = /dA(l) = 0. 
The result (|17|) together with the expressions 
Result 4.3. The following bound holds 

1 



gives the required result 



P. < 



1 '^-^Ddh{Ci,C2) 



where 



with 



Proof. Let us consider 



3-2^/2 

DaniCuC^) = Ex {/,\ (^|^) ^(^^il^) 
= ^ - ^/2 (V^ + VT^) + ly/x{l-x), Vx G (0, 1). 



where 



with 



= 2x + 2 - (V^ + 1) V2x + 2 



Now we shall prove the convexity of the function fdh{x)- We have 



yj2x + 2 l + 



and 



fdhi^) 



2y/^ V2x + 2 2^ 

2(x^/^ + 1) - (x + l)V2x + 2 
4x3/2(a; + l)V2x + 2 



x3/2(x + l)V2x + 2 



, Vx > 0, 



(52) 
(53) 

(54) 
□ 

(55) 



(56) 



The non-negativity of the expression ()56p follows from the fact that the function 2"^ )^^'' ' 
s 7^ is monotonically increasing function of s. For proof refer to Beckenbach and Bellman [1]. 
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Thus, we have fj^f^ix) > 0, Vx > 0, consequently proving the convexity of the function fdh{x), 
Vx > 0. 
We have 

fkix) = fkd - X), X e (0,1). (57) 
=,,,M^)=|_V2 = iz|^ (58) 

and 

/i = fdhil) = 0. (59) 
The result (fT7|) together with the expressions (f57|) - (f59]) gives the required result (l55]l . □ 
Result 4.4. The following bound holds 

Pe<^[l-^DhAiCl,C2)], (60) 



where 



with 



fhAix) = - + x(l - x) - Vx(l-x), Vx G (0, 1). 



Proof. Let us consider 



where 



with 

(V^-1)^ (x-l) 



fhAi^) = X fhA = \ + xil - x) - \/x(l - x) 

fhA{x) 



2 4(x-l) 
Now we shall prove the convexity of the function fhA{x)- We have 



ihA\X) — o ^ I 1\ + 



2Vx 2(x + l) 4(x + l)2 
and 

X*^ + 3x2 + 3X + X - g^5/2 



4x5/2(2; + 1)3 

(x + \ f - x^/^ 

4x3/2(x + l)3 

( - 1)^ k^/i + 1)^ (x + 1) + 4x 



4x3/2 (x + 1)' 



> 0, Vx > 0. (61) 
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Since, f'^^{x) > 0, Vx > proving the convexity of the function fh/i{x), Vx > 0. 
We have 



/hA(^) = /hA(i-^),^e(o,i), 

fhAjx) ^ 1 
x-^oo X 4 



and 

/i = Aa(1) = 0. 

The result (fT7|) together with the expressions ([62|) - ([Mj) gives the required result dM 
Result 4.5. The following hound holds 



P. < 



1 



1 



where 



with 



Dhi{Ci,C2) = Ex\fi 



1 -ln2 

fP{Ci\x 



'hi 



2\X 



P{Ci\x] 



f*j{x) = 2 ~ 2 v^a;(l - x) - (In 2 + x In x + (1 - x) ln(l - x))J , Vx G (0,1). 



Proof. Let us consider 



D,j{C,,C2) = Ex (^1^) PiCi\x)'j , 



where 



1 — X 



with 



1 - 2a/x(1 - x) - (In 2 + X In X + (1 - x) ln(l - x)) 



(Vi-ir a; x + 1 / 2 

fhJ\x) = m X m 

■"^^^ ' 2 2 2 Va; + 1 



Now we shall prove the convexity of the function fhi{x)- We have 



— — In X In I 

2y/^ 2 2 Vx + 1 



and 



> 0, Vx > 0. 



4x3/2 (x + 1) 

Since, f'/jix) > 0, Vx > proving the convexity of the function fhi{x), Vx > 0. 
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We have 



n^JJoo 3.^00 X 2 2 2 

and 

fi = = 0. 

The result (fT7|) together with the expressions (j67|) - (l69]) gives the required result ([65 
Result 4.6. The following bound holds 



- 2 



1 - Dia(Ci,C2) 

21n2-l ^ ' ' 



where 



with 



DjAiCuc^) = Ex |/;a (^I^) nciix)^ 

fm{x) = ^[ln2 + xlnx+(l-x)ln(l-x)]- (2x - 1)^ Vx G (0,1). 



Proof. Let us consider 



I)/a(Ci,C2) = Ex { fh (^1^ ) ^(^il^) } ' 



where 



//A (a;) = xfiA 
1 



1 — X 



with 



^ [In 2 + X In X + (1 - x) ln(l - x)] - (2x - 1)^ 

^ ^ ' 2 2 V^ + ly 4(x + l) 

Now we shall prove the convexity of the function fiAix)- We have 

f' (x) = -lnx + - In + ^ 

■'^^^ ^ 2 2 Va; + ly 2(x + 1) 4(x + 1)2 

and 

Since, /"^(x) > 0, Vx > proving the convexity of the function fiA{x), Vx > 0. 



19 



We have 



/;a(^) = /;a(i-3;), (0,1) 

/(/A), 



2 4 4 



x—>-oo X 



(72) 
(73) 



and 



fl = /7a(1) = 0. (74) 
The result (fT7|) together with the expressions ([72]) - (f7¥|) gives the required result (f70]l . □ 

4.1 Comparison Results 

(i) In view of (|39|) and (|71|) we have 



P. < 



1- 3^/^a(Ci,C2) 



< - [l-4i?/A(Ci,C2)] . 



Since 2 In 2 — 1 > 0, then from (|70p and (|75p we have 



P. < 



1 



2 In 2 - 1 



DlAiCl,C2) 



< - [1-4I)/a(Ci,C2)] . 



(75) 



(76) 



Thus, we observe from (|75|) that the bound obtained in (|7U|) is sharper than the one obtained 
applying directly the inequality ([39]) . 

(ii) In view of ([39]) and ([65]) . we have 



P. < 



1 



1 -ln2 



Dhi{Ci,C2 



< 



1 



1 



15(1 - In 2 



-DdA{P\\Q) 



Since 3 + 8\/2 - 15 In 2 > 0, then from ([50]) and ([771), we have 



Pe< - 

- 2 



1 



2 — 

Ddh{Cl,C2) 



3-2V2 



1 

< - 
- 2 



1 



15(1 - In 2) 



DdAiPWQ) 



(77) 



(78) 



Again, we observe from ()78p that the bound obtained in ()50p is sharper than the one obtained 
directly applying the inequality (p9|) . 

(iii) In view of (j32]) and ([I0|) , we have 



P. < 



1 



1 



7-4^/2 



DdAiCl,C2) 



< 



1 



1 



7-4V2 



DhA{Cl,C2)) 



Since 7 — > 1, then from ([60P and ([79]) we have 

1 



Pe<^[l-4I);,A(Cl,C2)] <^ 



^ I^/xA(Ci,C2)) 



7-4\/2 



(79) 



(80) 



Here also, we observe from (jSOp that making different comparisons, i.e., instead of using (j39p 
if we use (|32p still the result obtained in (|60p is sharper. Using the similar arguments we can 
also make comparisons for the other bounds. 
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